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MULTIPLE AND HYBRID GRAPHICS DISPLAY TYPES 

2 

CROSS-REFERENCE TO RELATED APPLICATIONS 

4 Not applicable. 

6 BACKGROUND OF THE INVENTION 

The present invention relates to computer support of multiple display 

8 types. 

Present computer systems provide a certain amount of flexibility in 
10 combining multiple computer displays and display types to a single personal 

computer, workstation, or embedded system. For example, under the Microsoft 
12 Windows 98 operating system, it is possible to simultaneously display images 

on two displays, but each display must be connected to a video adapter card 
14 attached to an ISA or PCI bus via its own slot. The computer must be 

configured (not in real time) to support the two different adapter cards and the 
16 displays attached to them. Graphic libraries and drivers must be identified and 

employed for each output display type. Different displays cannot be easily 
18 swapped without extensive configuration. 

The following patents relate to the display portability problem addressed 
20 above: U.S. Patent No. 5,960,213, to Wilson, entitled "Dynamically 

Reconfigurable Multi-Function PCI Adapter Device; U.S. Patent No. 5,948,091, 
22 to Kerigan et al., entitled "Universal Digital Display Interface"; U.S. Patent No. 

5,910,180, to Flory et al.,' entitled "Context Virtualizing Device Driver 
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Architecture"; U.S. Patent No. 5,883,642, to Thomas et al., entitled 
2 "Programmable Retargeter Method and Apparatus"; U.S. Patent No. 5,799,204, 
to Pesto, Jr., entitled "System Utilizing BIOS-Compatible High Performance 
4 Video Controller Being Default Controller at Boot-Up and Capable of Switching 
to Another Graphics Controller After Boot-Up"; U.S. Patent No. 5,752,032, to 
6 Keller et al., entitled "Adaptive Device Driver Using Controller Hardware Sub- 
Element Identifier"; and U.S. Patent No. 5,606,657, to Dennison et al., entitled 
8 "Virtual Graphics Processor for Embedded Real Time Display Systems". 

However, unlike with the present invention, none of these solutions provide a 
10 single display adapter than can simultaneously handle and switch between 
multiple displays and display types. 

rBaftheiTTiure^ of b oth-H^steiL,aDd Lstroke display_ J^pes 

renders it difficult to use raster-oriented graphics applicatior^^ stroke 
14 display types. For example, VAPS formats, which are corwnon in the industry, 
are unable to drive stroke displays or to properly^^rkwith hybrid stroke/raster 
16 displays in both modes. The following patents-relate generally to this problem, 
but none provide the ability of the present invention to drive stroke and hybrid 
18 displays using VAPS formats: U.S^Patent No. 5,499,325, to Dugan, Jr., entitled 
"Brightness Controls for VisuaTseparation of Vector and Raster Information"; 
20 U.S. Patent No. 4,635:050, to Grothe et al., entitled "Dynamic Stroke Priority 
Generator for Hybrid Display"; U.S. Patent No. 4,631,532, to Grothe, entitled 

y 

22 "Raster Display Generator for Hybrid Display System"; and U.S. Patent No. 



4,0^094rto-ehaseTentTfled "Full Color Hybrid Display for Aircraft Simulators." 
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2 SUMMARY OF THE INVENTION 

The following summary of the invention is provided to facilitate an 
4 understanding of some of the innovative features unique to the present 
invention, and is not intended to be a full description. A full appreciation of the 
6 various aspects of the invention can be gained by taking the entire specification, 
claims, drawings, and abstract as a whole. 

Xbe-T5fesent invention is of a display interface device and' 
comprising: providing one or more display interfaces^onnectable to a 
10 computer bus of an individual personal computer, workstation, or embedded 
system; providing a video library; and driving any^ne^of a plurality of video 
12 displays of a plurality of types connected to,the one or more display interfaces 
from output of the video library. In ^preferred embodiment, the video library 
14 comprises video library information, such as OpenGL information. Driving of 
both stroke and raster display types can be done, as well as simultaneous 
16 driving of stroke display(s) of different types or raster display(s) of same or 
different types^-g^FPD, HUD, MPD, MPCD, as shown in Fig. 8). Hybrid 
18 stroke/raster,disp!ays can also be driven. The display interface can be provided 
by a pkjrality of interface card mezzanines. Dynamic switching between 
20 dispaysjn reaUime^s-prefei^ 

The present invention is additionally of a device and method for driving 
22 stroke displays using formats designed for raster displays (such as VAPS) 
comprising: linking generated code from the formats to a standard graphics 
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library; and providing stroke video drivers that ignore raster masking. In a 
2 preferred embodiment, linking is to an OpenGL library. The stroke video drivers 

preferably use occlusion memory in place of raster masking. Both stroke and 
4 raster displays can be driven and switching dynamically between them is 

possible in real time. 

6 The present invention is also of a device and method for driving multiple 

displays of different types using formats designed for raster displays (such as 
8 VAPS) comprising: linking generated code from the formats to a standard 

graphics library; driving a plurality of displays of different types from output of 
10 the graphics library; and dynamically switching between the displays in real 

time. In a preferred embodiment, linking is to an OpenGL graphics library. 
12 Driving is of both stroke and raster display types, and the stroke video drivers 

are employed using occlusion memory in place of raster masking. Driving of 
14 hybrid stroke/raster displays can be performed. 

The present invention is further of a device and method for driving a 
16 hybrid stroke/raster display using formats designed for raster displays (such as 

VAPS) comprising: linking generated code from the formats to a standard 
18 graphics library; and providing stroke and raster display inputs from output of 

the graphics library. In a preferred embodiment, linking is to an OpenGL 
20 graphics library. The stroke video drivers preferably use occlusion memory in 

place of raster masking. Dynamic switching can occur between stroke and 
22 raster video drivers in real time. 
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A primary object of the present invention is to provide a single video 
2 adapter interface that can drive multiple displays of the same, different, and/or 
hybrid types. 

4 Another object of the present invention is to provide the ability to drive 

stroke displays using VAPS formats. 
6 A further object of the present invention is to provide the ability to drive 

hybrid stroke/raster displays using VAPS formats. 
8 A primary advantage of the present invention is the greatly enhanced 

portability of displays and display types between systems without extensive 
10 reconfiguration required. 

Another advantage of the present invention is that it promotes reusable 
12 display formats and reduces the amount of testing needed to deploy graphics 

software on new and different display types. 
14 Other objects, advantages and novel features, and further scope of 

applicability of the present invention will be set forth in part in the detailed 
16 description to follow, taken in conjunction with the accompanying drawings, and 
in part will become apparent to those skilled in the art upon examination of the 
18 following, or may be learned by practice of the invention. The objects and 
advantages of the invention may be realized and attained by means of the 
20 instrumentalities and combinations particularly pointed out in the appended 
claims. 

22 The novel features of the present invention will become apparent to those 

of skill in the art upon examination of the following detailed description of the 
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invention or can be learned by practice of the present invention. It should be 
2 understood, however, that the detailed description of the invention and the specific 

examples presented, while indicating certain embodiments of the present 
4 invention, are provided for illustration purposes only because various changes and 

modifications within the spirit and scope of the invention will become apparent to 
6 those of skill in the art from the detailed description of the invention and claims 

that follow. 

8 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 The accompanying figures, in which like reference numerals refer to 

identical or functionally-similar elements throughout the separate views and which 
12 are incorporated in and form part of the specification, further illustrate the present 
invention and, together with the detailed description of the invention, serve to 
14 explain the principles of the present invention. 

Fig. 1 illustrates in hierarchical form the software running under the 
16 invention on a General Purpose Processor (GPP; the workstation, personal 
computer, or embedded system microprocessor) in combination with a 
18 reconfigurable image processing module (IPM); 

Fig. 2 further illustrates in hierarchical form the software running on an 
20 IPM or equivalent hardware; 

Fig. 3 illustrates an implementation of a user interface (in this case, 
22 VAPS) to the video library of the invention; 
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Fig. 4 illustrates the data and control flow from the display task through 
2 to the video driver outputs when code is employed to drive one or more displays 

of one or more display types; 
4 Figs. 5-7 are block diagrams of data and control flow through the low 

level Application Programmer's Interface (API) graphic drivers to the displays in 
6 different display and display type configurations; 

Fig. 8 is a block illustration providing an overview of an implementation of 
8 the video library of the invention and its relationships to the video hardware and 
other software; 

10 Fig. 9 is a block diagram demonstrating device driver switching in the 

invention; and 

12 Fig. 10 is a flow diagram for decision making concerning device driver 

switching. 

14 

DETAILED DESCRIPTION OF THE INVENTION 

16 

The present invention provides the ability to, on a single workstation, 
18 personal computer, or embedded system, and using a single interface card if 

desired, drive multiple displays of different types and to dynamically switch 
20 between them in real time. A commercial standard graphics library (such as 

OpenGL) is employed together with dynamically switchable driver sets allowing 
22 support of multiple displays of different types. The invention also provides the 

ability to use raster-based display formats (such as VAPS) with stroke or hybrid 
24 raster/stroke displays. 
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The present invention enhances reusability by enabling a single display 
2 routine to drive a variety of output types without the necessity of creating 
separate display routines for each output type. By using a commercial standard 
4 graphics library to create the display routine and tailoring the specific driver 
functions to work with the graphics library, as well as requiring all graphic 
6 interface to be through the graphics library, all hardware modes are isolated to 
the device drivers. Device drivers can then be created and modified to match 
8 the output without changing the display routine interface. The device driver set 
necessary to drive the varying output type is associated with each graphic 
10 context. When a graphic context is switched, the drivers are switched and a 
different output can be displayed to. The drivers can be switched dynamically, 
12 which makes multiple simultaneous outputs possible. This also allows for the 
support of hybrid modes in which multiple drivers can operate for the same 
14 output and drive raster and stroke on the same display if that display is capable. 

The architecture conveniently supports multiple displays, various modes (e.g., 
16 stroke and raster), and future display types and hardware that may be 
developed. A common software platform is thereby created that can be used 
18 transparently for a wide range of hardware and software applications. As an 
example, development of and modifications to graphics intensive operational 
20 flight program software are greatly enhanced by the present invention. 

The invention also enhances reusability by permitting the same VAPS 
22 frame to be used to create display pages for both raster and stroke displays that 
will look the same. Again, a commercial standard graphics library is employed 
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for linking the VAPS generated code to the display drivers. Accommodations 
are made in the stroke drivers to ignore masking that is used by raster displays 
and allow for the same effect by using occlusion memory for the stroke display. 
A new graphics context is used for each virtual CRT as well as treating each 
virtual CRT as a root CRT to get proper scaling. Each graphic context is tied to 
a specific output driver set, and hybrid mode can be used with VAPS by 
switching output drivers within a graphics context. Multiple outputs are also 
enabled in this manner by creating additional virtual CRTs using different device 
drivers. 

^Fh u suflwd ie p iefe rably employed in l l ie e in budi merrt-o f the i nv ent 
employing an image processing module manufactured by IHone^eil^'PM; e.g., 
12 a single VME card having a plurality of mezzanines for connection to a plurality 
of displays) includes a Real-Time Operating System (RTOS) such as VxWorks, 
14 the Tornado development environment,^the^OpenGL graphics language, and 
the Visual Applications Builder (VAPS)/display format development tool. Fig. 1 
16 illustrates in block form the software running both on a General Purpose 
Processor (GPP; the workstation, personal computer, or embedded system 
18 microprocessor) and av/\he IPM. Shaded areas indicate reusable software. 

Fig. 2 provides additional detail. Figs. 5-7 are block diagrams of data and 
20 control flow^rough the low level API graphic drivers to the displays in different 
display and display type configurations. Low level API pointers to the display's 




22 rast&P-e^-strorke- drivers are preferably initialized only once during power=on 
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initialization. Fig. 3 illustrates an implementation of a user interface (in this 
2 case, VAPS) to the video library. 

The present invention also permits the same VAPS frame to drive both 
4 stroke and raster displays. A commercial standard graphics library (e.g., 
OpenGL) links VAPS generated code to the display drivers to do either raster or 
6 stroke. The stroke display drivers are preferably modified to ignore raster 
masking and to use occlusion memory instead. Fig. 4 illustrates the data and 
8 control flow from the display task through to the video driver outputs. 

Hybrid displays can be driven from VAPS generated code as well as 
10 multiple displays. VAPS was designed to drive a single raster output display, 
but the present invention permits it to go beyond that limitation. The VAPS 
12 portkit is modified to create a new graphics context for each virtual CRT. Each 
virtual CRT is treated as a root CRT in order to achieve proper scaling. A 
14 commercial standard graphics library (e.g., OpenGL) links the VAPS generated 
code to the display drivers and each graphic context is tied to a specific output 
16 driver set. Hybrid mode is rendered possible by switching output drivers within 
a graphics context. Multiple outputs are rendered possible by creating 
18 additional virtual CRTs using different device drivers. 

Preferred design descriptions for the software of the invention next 

20 follow: 

Referring to Fig. 8, the preferred Video Library is a software interface for 
22 graphics hardware that allows programs that use it to produce high quality 
graphic images. The library allows a standard commercial interface to be able 
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to drive a variety of output types. The Video Library preferably comprises a 
2 graphics module which contains Graphics Library Utility Tools (GLUT) and 

OpenGL functions, a video control module which contains video functions that 
4 are not handled by the graphics module, and a device drivers module which 

communicates directly with the hardware. The device drivers are the functions 
6 that can be replaced to match the targeted hardware. Multiple drivers can be 

used simultaneously. 

8 The video control module is a set of functions that are needed for the 

image processing module that can not be accomplished using the Open GL 
10 libraries or the GL utility tool kit. This supports functions that are common 

among the drivers. Preferred data structures include: display, context, driver, 
12 and hybrid mode control, and hardware specific interfaces. 

The graphics library includes a subset of Open GL functions and Open 
14 GL utility tool kit functions. 

A subset of the GLUT kit library is preferably implemented for the image 
16 processing module of the invention. This library contains the functions 

necessary to initialize the display and setup the windows to put graphics in. 
18 This library follows the functional description of the GLUT API. The preferred 

data structures employed include the following: contexts initialization, context 
20 switching (device drivers switched with context), swapping buffers, color 

palettes control, animation control, and window state retrieval. 
22 Referring to Figs. 9 and 10, the low level functions are the interface to 

the device drivers that get swapped out depending on the output that is being 
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used. These calls are made by video control and graphics libraries and are not 
2 called directly by the display program. 

The Graphics Library is intended to provide the only interface to the low 
4 level graphic drivers. The graphics library includes a subset of Open GL 

functions, Open GL utility functions, and Open GL utility tool kit functions. 
6 The detailed descriptions for the preferred API GL Utility Functions are 

specified: inOpenGL Programming for the X Window System, Mark J. Kilgard, 
8 Addison-Wesley, ISBN 0-201-48359-9. 

The detailed descriptions for the preferred API OpenGL functions are 
10 specified in: OpenGL Reference Manual, Second Edition, Addison-Wesley, 
ISBN 0-201-46140-4. 

12 In summary, the present invention provides the ability to, on a single 

workstation, personal computer, or embedded system, and using a single 
14 interface card if desired, drive multiple displays of different types and to 

dynamically switch between them in real time. Raster-based display formats 
16 (such as VAPS) can also be used with stroke or hybrid raster/stroke displays. 

The invention thereby enhances reusability by enabling a single display routine 
18 to drive a variety of output types without the necessity of creating separate 

display routines for each output type. The architecture conveniently supports 
20 multiple displays, various modes (e.g., stroke and raster), and future display 

types and hardware that may be developed. A common software platform is 
22 thereby created that can be used transparently for a wide range of hardware 

and software applications. 
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The embodiments and examples set forth herein are presented to best 
2 explain the present invention and its practical application and to thereby enable 
those skilled in the art to make and utilize the invention. Those skilled in the art, 
4 however, will recognize that the foregoing description and examples have been 
presented for the purpose of illustration and example only. Other variations and 
6 modifications of the present invention will be apparent to those of skill in the art, 
and it is the intent of the appended claims that such variations and modifications 
8 be covered. The description as set forth is not intended to be exhaustive or to 
limit the scope of the invention. Many modifications and variations are possible 
10 in light of the above teaching without departing from the spirit and scope of the 
following claims. It is contemplated that the use of the present invention can 
12 involve components having different characteristics. It is intended that the scope 
of the present invention be defined by the claims appended hereto. The entire 
14 disclosures of all references, applications, patents, and publications cited above 
are hereby incorporated by reference. 
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